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Abstract 

In this paper we calculate Kolmogorov-Sinai entropy Iim{S) of the 
generalized Markov shift associated with a contractive Markov system 
(CMS) using the coding map constructed in |12j . We show that 

tlM(S) = — ^ / Pe log Ped/l 

where /i is a unique invariant Borel probability measure of the CMS. 



1 Introduction 

In J_| we introduced a theory of contractive Markov systems ( CMS) which 
provides a unifying framework in so-called "fractal" geometry. It extends the 
known theory of iterated function systems (IFS) with place dependent probabil- 
ities PQ[1] in a way that it also covers graph directed constructions of "fractal" 
sets In particular, Markov chains associated with such systems also cover 
finite Markov chains. 

By a Markov system we mean a family 

(K l{e] ,w e , Pe ) e£E 

(see Fig. 1) where E is the set of edges of a finite directed (multi)graph (V,E,i,t) 
(V := {1, N} is the set of vertices of the directed (multi)graph (we do not 
exclude the case N = 1), i : E — ► V is a map indicating the initial vertex 
of each edge and t : E — > V is a map indicating the terminal vertex of each 
edge), K\ , K2 , ■ ■ ■ , Kn is a partition of a metric space (K,d) into non-empty 
Borel subsets, (w e ) e eE is a family of Borel measurable self-maps on the metric 
space such that w e (ifj( e )) C ^Q( e ) for all e £ E and (p e ) e6 £ is a family of 
Borel measurable probability functions on K (i.e. p e (x) > for all e G E and 



See_E Pe( x ) = 1 f° r a ^ x e ^0 (associated with the maps) such that each p e is 
zero on the complement of -?Q( e ) . 



N = 3 ^2 




Fig. 1 

We call a Markov system (K^, w e ,p e ) eeE contractive with an average con- 
tracting rate < a < 1 iff it satisfies the following condition of contractiveness 
on average 

^ p e (x)d(w e x, w e y) < ad(x, y) for all x, y G Kj, i = 1, AT. 



Markov system (-fQ( e ), w e,Pe) eeE determines a Markov operator {/ on the set 
of all bounded Borel measurable functions C°(K) by 

[//:=5>e/°w e for all/e£°(lf) 

and its adjoint operator U* on the set of all Borel probability measures P{K) 
by 

LTV(/) := y C/(/)c^ for all / G C°(K) and i/ G P(A"). 

We say a probability measure [i is an invariant probability measure of the Markov 
system iff it is a stationary initial distribution of the associated Markov process, 
i.e. 

U*/i = fj,. 

A Borel probability measure [i is called attractive measure of the CMS if 

XJ* n v /i for all v G P{K), 



2 



where w* means weak* convergence. Note that an attractive probability mea- 
sure is a unique invariant probability measure of the CMS if U maps continuous 
functions on continuous functions. We will denote the space of all bounded 
continuous functions by Cb(K). 

The main result in jTI] concerning the uniqueness of the invariant measure is 
the following (see Lemma 1 and Theorem 2 in jllj). 

Theorem 1 Suppose [K^, u> e ,p e ) egB is an irreducible CMS such thatK\,Ki, 
...,Kn partition K into non-empty open subsets, each p e \K i{s} is Dini- continuous 
and there exists S > such that p e \K i(e) > S for all e £ E. Then: 

(i) The CMS has a unique invariant Borel probability measure [i, and fJ<(Ki) > 
for all i = 1, N . 

(ii) If in addition the CMS is aperiodic, then 

U n f(x) -> /*(/) for allxeK and f 6 C B (K) 

and the convergence is uniform on bounded subsets, i.e. /i is an attractive prob- 
ability measure of the CMS. 

A function h : (X, d) — ► R is called Dini- continuous iff for some c > 

r 0(*) , 

/ -^-dt < oo 
Jo t 

where <f) is the modulus of uniform continuity of /, i.e. 

<f>(t) := sup{|fi(x) - h(y)\ : d(x, y) <t, x, y e X}. 

It is easily seen that the Dini-continuity is weaker than the Holder and stronger 
than the uniform continuity. There is a well known characterization of the 
Dini-continuity, which will be useful later. 

Lemma 1 Let < c < 1 and b > 0. A function h is Dini- continuous iff 

oo 

c/> (bc n ) < oo 

71=0 

where 4> is the modulus of uniform continuity of h. 



The proof is simple (e.g. see 

Further, with the Markov system also is associated a measure preserving trans- 
formation S : (£,#(£), M) — ► (£,B(£),M), which we call a generalized 
Markov shift, where £ := {(..., <r_i, <jq, <j\, ...) : <Xj S E Vi G Z} is the code 
space provided with the product topology, $(£) denotes Borel cr-algebra on £ 
and M is a generalized Markov measure on £>(£) given by 

M( m [ei, ...,e fe ]) := p ei (x)p e2 (w ei x)...p eh (w ek _ 1 o ... o w ei x)d/j,(x) 
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for every thin cylinder set m [ei, ...,e k ] := {er G E : a m = e x , ...,a m+k -i = e k }, 
m G Z, where fi is an invariant Borel probability measure of the Markov system, 
and S is the usual left shift map on E. It is easy to verify that S preserves 
measure M, since U*fj, = (see [T2]V 

For a CMS, this two pictures, Markovian and dynamical, are related by a coding 
map F : (E, £>(E), M) — ► K which was constructed in ^21- It is defined, if K 
is a complete metric space and Peln^'s are Dini-continuous, by 

F(a) :— lim w ao o w a _ 1 o ... o w rTm x i / cr \ for M-a.e. cr e E 

m — > — oo 

where x\ € ifi for each i = 1, ...,7V (the coding map does not depend on the 
choice of Xi's modulo an M-zero set). This coding map is the key for our 
calculation. 

Example 1 Let G := (V,E,i,t) be a finite irreducible directed (multi)graph. 
Let E G := {(..., <r_i, <ro) : u m £ E and t(a m ) = i(a m -i) Vm G Z\N} (one-sided 
subshift of finite type associated with G) endowed with the metric d(a,a r ) := 2 k 
where k is the smallest integer with Oi — a[ for all k < i < 0. Let g be a 
positive, Dini-continuous function on Eg such that 

^2 g(y) = 1 for all x e e g 

!/€T- I ({x}) 

where T is the right shift map on E^. Set Ki := {ct G Eg : t(ao) — i\ for every 
i G V and, for every e G E, 

w e (a) := (...,cr_i,cr ,e), p e (er) := £/(..., ct_i, cr , e) for all ct G K l(e) . 

Obviously, maps (w e )eeE are contractions. Therefore, (if j( e ) , w e ,p e j E defines 
a CMS. An invariant probability measure of this CMS is called a g-measure. 
This notion was introduced by M. Keane 0. The Kolmogorov-Sinai entropy of 
the generalized Markov shift, which is a natural extension of the g-measure fi 
in this case, is well known: 

hAi(S) = ^2 / 3( ecr ) 1 °gff( ecr ) d A 1 ( cr ), 

eEE'' 

where ea :— (..., cr_i, ao, e) (see jH])- 

So, we are going to extend this result to a more general CMS, e.g. as in the 
next example. 

Example 2 Let R 2 be normed by Let K x := {(x,y) G M 2 : y > 1/2} and 
^2 := {(x,y) el 2 : y < -1/2}. Consider the following maps on K : 
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with probability functions 

pi ( I ) : = (^ sin2 lK x '^H i + ^|) ^(^y)' 

P2 ( y ) := (is cos2 H^'^ll 1 + 7) 

P3 ( y ) := sin2 " ^' ^ " 1 + ^0 1/f2 ^' ^ and 
P4 ( ^ ) := (15 cos2 H^'^lli + 7) W^s/)- 

A simple calculation shows that (i"Q( e ), w e ,p e ) e g{i,2,3,4}) where i(l) = i(2) = 1 
and z(3) = i(4) = 2, defines a CMS with an average contracting rate 209/210. 
Note that none of the maps are contractive (By Theorem 2 in it has a 
unique (attractive) invariant probability measure.) 



As this paper had been known for a year as a preprint, I was informed by 
Wojciech Slomczynski that a similar entropy formula for some partial iterated 
function systems plays a central role in his recent book [H]. However, the result 
presented in this paper is not covered by any results from his book. Moreover, 
our computation is based on the existence of the coding map for some contractive 
Markov systems The latter is a nontrivial fact which seems to be of a 

fundamental nature in relation to the uniqueness of the invariant probability 
measure for a contractive Markov system. 



2 Main Part 

Let (-fQ(e), w e ,p e ) e&E be a contractive Markov system with the average con- 
tracting rate < a < 1 and an invariant Borel probability measure fi. We 
assume that: (K, d) is a metric space in which sets of finite diameter are rel- 
atively compact and the family K\,...,Kn partitions K into non-empty open 
subsets; each probability function p e |if i(e) is Dini-continuous and bounded away 
from zero by 8 > 0; the set of edges E is finite and the map i : E — > V is sur- 
jective. Note that the assumption on the metric space implies that it is locally 
compact separable and complete. 

First, we prove what seems to be the main lemma for the generalized Markov 
shift associated with a contractive Markov system. This lemma is also used in 
[13] . For that we need to define some measures on the product space K x S. 

Denote by A the finite a-algebra generated by the partition {o[e] : e G E} of £ 
and define, for each integer m < 1, 

+00 

Am . \J S A, 

i—m 
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which is the smallest cr-algebra containing all finite c-algebras V™ =m S~ Z A, n > 
to. Let x G K . For every integer to < 1, let P™ be a probability measure on 
cr-algebra An given by 

P™(m[e m , ...,e„]) = p em (x)p em+1 (w em (x))...p en (w en _ 1 o ... o iu em (:r)) 

for all thin cylinders m [e m , ...,e n ], n > m. By Lemma 1 from ^2], x i — ► P™(Q) 
is a Borel measurable function on if. Therefore, we can define, for every integer 
to < 0, 

M m (AxQ) := f P™(Q)d[i(x) 



A 



for all A G and all Q G An- Then M m extends uniquely to a probability 

measure on the product cr-algebra B(K) ® An with 

M ro (fi) = /" P™ ({cr G E : (i, cr) G 0}) ^(x) 

for all £1 G B(iT) ® An- Note that the set of all f2 G S(iC) <g> An for which 
the integrand in the above is measurable forms a Dynkin system which contains 
the set all rectangles A x Q, A G B(K), Q G An- As the latter is H-stable 
and generates B{K) (g> An, the integrand is measurable for all ft G B{K) <8> An- 
Further, note that P™ ({cr G E : (a:,cr) G Q}) = J l n (x, cr)dP^(cr) for all ft G 
B{K)®A m . Therefore 



dM m = J J s{x,a)dP™(a)d(j,(x) 

for all B{K) ® An-simple functions s. Now, let tp be a £>(-KT ) ® An-nieasurable 
and M m -integrable function on K x E. Then the usual monotone approximation 
of positive and negative parts of ip by simple functions and the B. Levi Theorem 
imply that 

r ^dM m = ( I \jj(x,a)dP™{(r)dLi{x). 



Lemma 2 Suppose C :— J^iLiIx d(x,Xi)d/i(x) < oo for some xi G Ki, i = 
1, ...,N. Let i[ei, ...,e n ] C E be a thin cylinder set . Let J- :— \f^l Q S l A. Then 

Em (l 1 [ei,..., en ]l^') ( CT ) = P F(a) (i[ei, --.,e„]) for M-a.e. a G E, 
where Em (-I-) denotes conditional expectation with respect to measure M. 

Proof. We can obviously assume that (ei, e„) is a path of the directed graph. 
Set T m := V™ o S'A for all to G Z \ K We denote further a (-to + l)-tuple by 
(a m , ...,cr )* if M( m [cr m , ...,cr ]) > (i.e. (<r m , cr ) is a path). Then obviously 

_^ / l l[ei ,...,e„]dM 

^M(l l[ei) ...,e„]M(-)= E ""muL,...,^]) ^--^^ 

(CT m ,...,cro) 
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for M-a.e. a E S. Since 07"m) m <o i s an increasing sequence of c-algebras and 
T is the smallest cr-algebra containing all T m , it follows by Doob's Martingale 
Theorem (e.g. see p. 199) that 

Em (l 1 [ei,...,e„]|-^m) (li[ei,...,e„]l-? 7 ) (1) 

M-a.e.. 

Now, set 

Z^(o-) := w ao o ... o w CTm x and Y m (a) := w aa o ... o w am Xi^ m ) 
for all x E A", c £ S and to < 0. Further, define 



(o- m ,...,<T )* 



/ d(Z^(a),Y m (a))dM m (x,a) 

Kx m [a m ,...,a ] 



1 



o- m ,...,o- 



](*) 



M m (K X m [er m , ...,cr ]) 
for all a E S. Then 

/" X m dM = y d (Z* (<r), y m (a)) dM m (z, a) 
= y E ^™( x )---Pcro( u; o-_ 1 ---w C r m a;)rf(w C ro--- w cr m a;, «; o - ...«; <7m a; i ( <rm ))d/i(i) 

c m cr 

< a- m+1 / d(a,a:i)dAt(a:) = a - m+1 C. 
Set 



i=l 



A"; 



n m := jcr E £ : X m > a ™ +1 c| 
for all to < and f2 := Hn<o Um<n Then, by Markov inequality, 

M(O m ) < a^^ 1 . 

Hence, M(fi) = and 

X m (cr) -► for all cr £ £ \ O. 
Now, for cr £ £ with M ( m [cr m , ctq]) > 0, 



/ l,[e, ej^ 

re ,...,o- ] 



--PfW (i[ei,...,e n ]) 



M ( m [cr m , (To]) 

I Pa m (x)...Pa (Wa_ 1 ---W am x)p e JZ^(a))...p en (w eri _ 1 ...W ei Zf n ((T))dfi(x) 



-p ei (F(a))...pe n (we n _ 1 ---w ei F(a)) \ . 



(2) 
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Set p(x) := p ei (x)...p en (w en _ 1 ...w ei x), x G K. Note that the average contrac- 
tiveness condition and the boundedness away from zero of the probability func- 
tions on their vertex sets imply that each map w e \K i(c) is Lipschitz. Since each 
Pe\K i{c) is Dini-continuous, it follows that each function p ek ow ek _ 1 o...ow ei |if i(ei) , 
1 < k < n, is Dini-continuous. As bounded Dini-continuous functions form an 
algebra, p\x i{ci) is also Dini-continuous. Let r\ be the modulus of uniform con- 
tinuity of £>|_R- i(ei) . By the Sublemma from there exists ip : [0, oo) — > [0, oo) 

such that ip{t) > r/(t) for all t, ^{t)/t is non-increasing, and J Q ip(t) jtdt < oo. 
Set 



1 



1 - a 



dt for u > 0. 



Then (5 is continuous, concave and /3(0) = 0. Moreover 

/?(«) > 



1 -a 



^ t ) dt >j_m iU{a -^ 1)=m > v{U ) 



t 



1 — a ua 



for all u > 0. Hence, rj(u) < (5{u) for all u > 0. Therefore, 



© < 



/ P oZf n {a)dM m (x,a) 

Kx m [o- m ,...,o- ] 



M m (K X m [cr m , ...,cr ]) 



-poY m (a) 



+ \poY m (a) -poF(a)\ 



< 



< 



K X ,„ [er„ 



/ \ P o (a) - p o F m (a) | dM m (a;, a) 



M m (K x m [er m , ...,cr ]) 
/3(d(^(a),y m (a)))dM m (x,a) 



Kx m [<7„ 



M m (K x m [a m , ...,cr ]) 
/ J d(Zf n (a),r m (a))dM m ( a; , ( 7)\ 



< P 



Kx m [o- m ,...,o-o] 



M m (if x m [er m , ...,(T ]) 
/3oX ro (o-) + \poY m {a) - P oF(a)\ . 



— + \poY m (a) -poF(a)\ 
+ \poY m {a)-poF(a)\ 
+ \ P oY m (a)-poF(a)\ 



\ 



J 



Hence 



Em (l 1 [ei,...,e„]l^ r m) (c) ~ Pp(a) G [ e i> •••) e n]) < P ° X m (a) + \p o Y m {a) -poF(a)\ 

for M-a.e. a G S. By Corollary 1 from and the continuity of p on if, the 
second term also converges to zero M-a.e.. Thus 



E M (l 1 [ Cl ,..., e „]|^m) (cr) - Pp {(T) (i[ei, ...,e„]) 



as m 
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for M-a.e. a € £. With QJ, this implies that 

Em (h[ei,...,e n ]\F) (o-) = ^fm (i[ei,...,e„]) 
for M-a.e. cr e E. □ 

Proposition 1 // invariant probability measure fi is unique, then 

F(M) = M . 

Proof.Let U* be the adjoint of the Markov operator associated with the CMS. 
It is sufficient to show that U*F(M) = F(M), since \x is the unique invariant 
probability measure. Let / S Cb(K). Then 

U*F(M)(f) = I P*f° WedF(M) = J2 [ Pe°Ffo We O FdM. 

eeB eEE'' 

Let e £ E. By Theorem 1 (iv) from [TT] . d(x, Xi)dfi(x) < oo. There- 

fore, by Lemma El 

£ M ( l l[e] | ^) (*) = P; (CT) (i [e]) = p e o F(er) 

for M-a.e. a 6 S. Since f o w e o F is bounded and JF-measurable, it follows by 
a well known property of the conditional expectation that 

E M (l l[e] / o w e o F| JF) (a) = p e o F(tr)/ o w e o F(<r) 

for M-a.e. er € E. Hence, by the shift invariance of M, 

U*F(M)(f) = fl l[e] (a)fow e oF(a)dM(a) 

eeE 

= X] / 1 iN °S~ l (cr)fow e oFoS- l (a)dM((r) 

= E / lo[e](0/°i»^M 

e£E 



□ 



Theorem 2 Lei }im(S) be Kolmogorov-Sinai entropy of the generalized Markov 

shift associated with the contractive Markov system. 

(*) tfJ2iLi Ik d(x,Xi)dfj,(x) < oo for some x t e Ki, i = 1, ...,N, then 



h M (S) = -J2 I Pe\og Pe dF(M). 

_ r- El « 



eeE,,, 
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(ii) If invariant probability measure fi is unique, then 

h M (S) = -^T / p e logp e dfl. 



eeE 



(<0 



Proof. It is well known that /ia/(5 i ) = ft.A/(5 l_1 ) (e.g. Theorem 4.13 in ^Hj) an d, 
by the Kolmogorov-Sinai Theorem (e.g. Theorem 4.17 in ^HDi hniS -1 ) = 
/im(S' _1 ,A). Further, using the notion of conditional entropy (e.g. Theorem 
4.3 (ix) and Theorem 4.14 in [T71|). 



h M (S-\A) =H\S- 1 A I y^-Mj . 
Set T := V^o • 54 - 4 - Hence 

M^) = -2 / ^(^[ell^) l0g£(l l[e] |^)dM. 

By the assumption in (i), Lemma implies that 

E(l l[e] \T) =p e oF M-a.e. 
for each e € E. Hence, with OlogO = 0, we have 

h M (S) = -J2 [pe°Flog(p e oF)dM = -J2 f Pelog Pe dF{M). 

«i(e) 

By the assumption in (ii), Theorem l(iv) in pi] and Proposition imply that 
h M {S) = - ^ / p e logp e dfi. 



□ 
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